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(54) IMAGE PROCESSOR AND METHOD THEREFOR 

(57)Abstract: 

PROBLEM TO BE SOLVED: To automatically generate 
the shape model of an optional object in a complicated 
shape such as the head part of a human while satisfying 
practical accuracy and processing speed. 
SOLUTION: By providing an image fetch part 0, a feature 
point extraction part 1, a three-dimensional motion 
information extraction part 2, an inter-image linear 
connection calculation part 3 and a distance information 
detection part 4, the three- dimensional shape model of 
an object is automatically generated. The image fetch 
part 0 fetches the time sequential image (moving image 
sequence) of the object and the feature point extraction 
part 1 performs feature point extraction required for 
preparing the model of the object. The three- 
dimensional motion information extraction part 2 
correlates the extracted feature points with each other 
between successive images and obtains the motion 
information of the object, that is the change information 
of a three-dimensional position/posture, from the 
position coordinate information of the feature point group. The inter-image linear connection 
calculation part 3 obtains a linear connection restraint and the direction of a light source 
established among the time sequential images. The distance information detection part 4 
decides the three-dimensional shape of the object by obtaining distances at individual points in 
the image and the normal vector of an object surface by searching them corresponding to 
geometrical luminance restraint conditions. 
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tt$;ftfc#m&©»gfitl . (j) Sr I Kfc^TIBft [0 0 6 7] 

-rs^as-cts. * [ici3] 

I = fiS (11) 

6 = tfi,i 2 J»] (12) 

S= [2(1), 8(2) s^)] (13) 



[0 0 6 8] J:<to?>ix-CV^4J:5lc«JHt^iSHc«l:5 [0 0 6 9] 

##tt-Sf T?»±* < , -jRlcttffiS© 3X3 jEajff^iJ 50 mi 4 ] 
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(11) 
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Bs=(BA- 1 )(Al) 

s=As < 14 > 

Sr«rfc+ff5»jA*tt-Jli-ntfffiKfl!f«i:IBIi$C3tiRo io*1-fc;fc>*, i?ija© s (l) #4:4007 u-A0%fli'<4' 

[0 0 7 0] Sl(ll)©tT?iJs^*^53t*©«> [icl 5] 



s(i) ■« R(j) > 8(1) 



(15) 



tO©7U-A^f, j #|07W- i>.(::/Ht"C©&tt©3 



[00 7 1] 5$(14)W5a©«*iJ©M«fc, ifE©*^ 

20 * h/w*Wci--<#^#S;(i5)icf^Ai-5t. K&a; 



[»1 6] 



As(j) = R(j) T As(l) 



(16) 



HWbfMo &.(l6)n&®®mc*ILX&mm&17i' ★fifcSS«3©tt*tt#fc5fc»i:AHR-C#.6. C©tt 

Stt£&^V^Tfaffi&&^£ftfc©»£l-3fc»lC{± N 

LX&m<OV->7fr&Z— o©D±»f, *©j<ifc 

tLt#x.ttJ:v^\ ^©^vy/^JSawUff^* 
30 ftKf+gLTSK £ ir-C. *©««©43Bd»e>W-»1-5 

5. ^(6) ts;(i4)d^ 

(«1 7] 

(17) 



1-5 1 trw a © 9 mommies ^x<om^m^m 

[0 0 7 2] L.^i^L^©»iCttgS^5 3^oT*3«9, 

IfO) = B7AS(j) 



«±fc^fc^AKH^5*#<16)»tf<17)*A/j 6 [$Cl8] 
H^^3tt©#^llO^T$t*TSai-5i, #40 

AS(2) = R(2) T As(l) 
As(3) .= R(3) T Aa(l) 
IiU) = BjA&ij) (> = 1,2,3) (18) 



(d) EfttttttttUflS 



50 ftfc, Eittf««m«4©#iiH**/S0ji=.o^-c. a 7 



(12) ^2 0 00-2 5 9 8 3 5 

22 

* [00 7 6] t^t>> lSBOHfcfcfc^-Ctfaffi© 
i #HSB3itfcIi5lS0>l*S I i(l) 

&$thtzm&l i (2) , I i (3) , I i (4) £»JU 
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[0 0 7 3] S*«)^m^l4»M^^/4^$>5S*H^ 

& it 5 j*& m t^sf a m&vm— \c l t # 0 -cse 

[0 0 7 4] rro1f[i:^±Bl7(C4ttOB#^^Jii^^^fflV^ 
XTikZix&Zb < -CfcS,, 10 
[00 7 5] giHH<t!tf>teSccDiiii|f i , (i) 

m<o 3&<Dmmz&^xt&w¥mcftfcLx^5>& 

<DM&1 i (2) , I i (3) , I i (4) <DmZ®£Xmt$ 

&m<r>mzt Lxm^tix^^. * 

* I- ;v) «r Bj (Z) 33 § , ±gB = 1-4) * * t #>X I,(j; Z) 



[0077] &5$e.MzZ&fe-fZ> t # r*Uc*H-5 3 

[0 0 7 8] 
[*SU 9] 



(19) 



&3ftm5U5/&&U Ctt^ft/h2ftO^*T*t>ot i * [0 0 7 9] 

<m&-tz,Mk lx&vdsvik^? h*znz>„ it2o] 

= iju;z)& T m T r\ (20) 

Vti;Z) = B^(Z)5 (21) 

4 

= £fc(j;2)-1.0;.z» l . (22) 
J=l 

ffflSBSftE i (Z) ofH|[*fTV\ fMBGfl»«r*'h (S» h*ff-JMB4 3 tc «t otliMl©^^ h^Srtt* 

Wfctt*) t-fZ>zzt>iX*:0&x<n$e.Mb-tZ> c SI -c#5„ :of^ «iaBIWBB8jBcfH|[«4 l^jsitss; 

±0»f^SrH{fc±o«-jfelc*JV^T*ffi-5Ci:-CH«!^ 40 <2i)ttft5S;-Citit**.e>ft5. 

ftOSBHiifc&ll-S. [0 0 8 1] 

[0 0 8 0] CC-C, fHE*JR^lft*tS«BJ3 3ICi9** [tfc2l] 

i, T 0;Z) = BT(2) 8 (23) 

*** z **^m bt (z) .tiunitio. vomtmmm^ r ***** 



(13) 

23 

tLXZ. Zttik-fzt 

[fSt2 2] 

l._ 

= ~ 2^(^o* + D k grad k ) (24) 
tew 

irft5„ fcfc'LZok liH^kKfcttSJIfft©— ifcifi 10 
Dk 13®* k^ibBfit i £T-©S§86, grad k (i 

SsH^IrIB* ^feJUHSftS. mi!ES§$£¥lJ£gB4 2<D 
Lfc±T^;(24)icj:5*fft«Sffiz. tcStifiv^ 
*t UT^A-^^J^tfoCilcftS^ Ufft 

«a©jie««»e>itt»a*©ife5«[«)*ta-f-ct-s:pitB 20 

[0 0 8 2] ^JtE-f^'J 1 
5t>©-mftV\, 

[0 0 8 3] Sgg|«^954 2 "CffiKZ 

[0084] %m\c^xizzb\z y z.z.xmm ufc* 

[0 085] ^ 2 coggjg^^g 
III 9 2 oSH6«*©»»««*WSr*-r. 
[0 086]|51 ©*16^ttT?»±, *-Jt«(0#^^o 

^xmwLtzAK m2<Dmmmmx^ mm%m*ft&* 

I = (B|B) D ft ^jj (fc = 0,l,2,3) 



|2 0 0 0-2 5 9 8 3 5 
24 

ft 5. ^©fcfelc, SCO) *»?>a;(i8)*-ci±. $i»^ 
M&mZ&m^. 5£(i9m»fc:o^-a±, %2<r>%W6 

[0 0 8 7] LfciJSot, 11 1 o ic^-TilM^^-g- 
ffittgffi 3 ©WSfT^JgTBftff » 3 2 |£*SV^-CS»j6* 

[0 0 8 8] UT, 4TO^*»jJS« 

© icjo (t 5 £ & X tt ft i> Z. t -tfftftttftff 

&&$\-&-rZZt&X%5o *&{C3te»*lBj«t£SiJ3 3 

[0 0 8 9] i-ftfot,, nmffnWf&U 3 1 -CsSS Lfc 

0 &&xm&ffm&jmtm 3 2 g*»©*yi*fT 3 &m 

[0 0 90] #g=fT?iJ5>«iJ|fB3 0 -Cfi, #*ff?iJ£#>§ 

(oftmix-z 5 i , B%npmBm / f& 3 2 w®©&s 

[0 0 9 1] £TF, tt£fif^©£««:Hfttt«:*5 £ 

-So 

[0 0 9 2] *f, 2j£jteJK(l. , 1* bts<) 
\z ft ■Sjtfgff yiJtt^-fcJRTfc** ft 5 (10) ic^ 

[0 0 9 3] 
[12 3] 



(IS) 



CCf, s 1 t s 2 liftjig 1 . iU lc*fj£ L 
fc^iJSr^, Dk (k = 0, 1, 2, 3) 113X3^1 
<fcfT*l E RX$m?rmfrbt£Z>ft.<D 4 6 x 6 nm 



[0 0 94] 
[«24] 



Do= ( E E )' D,= ( E )' Dl= ( e)' D9 = ° 



H>o fifties 1 . t 1 2 ©M*©?t^l-flsW$ 
^-CV>S#^-, ]=>> Xt^ID 2 1 . 



50 



[00 9 5] V^, n, mOftWL&Vohno fid? 



(14) 
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[0 0 9 6] oJ9, Bsfc*3»#*8fc*L-C#;ln 
i =no +ni +ti2 t'^'bo 
[0 0 9 7] *«itfrJl|©#W©2fife«:KW1-5 
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I k (k = 0, 1, 2) -0^#J^^§ixTV^i:-t- 
5., ccot#S;(i9)»ii!>:(OJ;'?lc^S,T'#. 
[fc25] 



(20) 




(io) t 15)» 



I fc = B 4 « 4 (fc = 0,1,2) 



S^MiD* (k = 0, 1, 2) l£*fJ&1-.5ft$>cD [t26] 

S 0 = St+Sj 



(21) 



(22) 



-efo5^irlcffiE1-So 20* </\, CMci9«B»fT5>l I 2 (n. 
[0 0 9 8] *(20)-Cttft©«RS^S:»^LT*jL5rt =n« + m ) . jSSgff^J (*&©<!: 5 fcjEJpSi: * 

t'D 3 l:MJ5t5 I 3 ZMULT^ZiK mz%M 5„ 
I. £8 1 2 [0 0 9 9] 



1= 





(23) 



* (23) TffiJ[± 



•■(' 



so 

si 



(24) 
(25) 



I = B3. (26) 
* (23) *s, (, 5 i a l-»irff?l I, t I t tf> 9 y ? i±** 3 0 , jE*a*3«jt?r?l| I £*fc LT 



rate* #»«*??!] 1 ict>*©**ar»±*5fc»» 

[0100] r C T\ ffSffiFlJ I »M®fTi ! n j 50 



*fc»3MfM I . ©#mt»J©3&7c«#2l»!L. 
[0 10 1] Lfc^oT. »»^*»ai-5IB«H:. £ 



(15) ^2000-2 5 9 8 3 5 

27 28 

»5c»»ffiMI^«t5wi:lc##$*T,5 0 [0 10 3] 

[0 10 2] KTtlt *TCO^S*5»^Wlw^tBT? Iic2 8] 

n ^tcSIH -ft" (V ,S p a (a = 1,..., S Y) »^**0 = l,..., : V**<0*KmraOTffi**-£C5rS-*- 

a. 

5 1 u--uij m =9 1 a 1 n--na m =4. 
<D«s*2(»iL f (i = i,...,m) tta^Mcid^aax-^iifijE-ra. T**?-%ac«2MLi®-©u„, or*s: 

2Wffi^H-P*4t-fa. >V>rfcfic5gL. iVx :Vlhlff?ilG = (Go3) * J: t iCJgiH- 2> . 

Co? = (p«,p'). (27) 



=, ■■*, ^ A. n (Sl0©rfi©*i5f [0104] 



Q = £ W- (23) 



C?^ = II T = (I°,I^) (29) 

i-*t>t>, a t j3 li 2 o©ffiR©4e»£, I ' t I ★ *) tU mt^lt^^ h/KDEjSit^Sr W 

s atmnm i ©^-fe.^tifci^jsi-s^ir-fs. . , -, v» s } ti--s„ ^Lt ni x n , 

SlliUC^H^^^ero^iEiC^^JI?*)^,, ^rW WM= (H.» ) 5tc£i£L 

HtffS&Ai ^, (ftDJ©6ffl©*##* 1*3 01 

s 



H = ^ii ; uT = uU T (30) 



^atStfflffJiJfcii?^. z.<ot #Jt3E£ISI«to#SH;:j: o i« cio, el. -c**.if = 0 

•? , c <D*mnm m j±«-w»^# «h * [0105] 011 wsff^j^fjSB 3 0 onmm 

ii-CS>6*»R*5*»*H., ©tHIlca^VN-CWWr-C* [0106] *-f , fcffifT 3 0 0 X'ti, M&ft 

©fi£*jJS&**ttfH., *ffiff?>J [0 10 7] 

»«Wfcff5#fcfcBlT-eH$'<.&. _ #40 

I = USV 1 ". (31) 

JtAfryys^r^fc^^weo^^tts-Cjj-ic^o-^. nnv t vitu T u = v T v = E a y 8 

fS) *4iE«iI35fTyiJ-?, -f-<0«-*7S*II T iI T I^@*-!^ h^^yiJt-ts. fe^r ni x KBiTiM Hli U » 

flkftr <n 6 5»J * fcffl ». - r s n. 



[0 10 8] S^^^Sffiff^JHUffa^J I A>6 50 Atv#x-Ct« ^©ii©MH., 



(16) ^2 0 0 0-2 5 9 8 3 5 

29 30 

j3£Atl#;t5i, ffMU©#JS-*-5fTa* j3#A*t [0 10 9] 

IS*i:UT*affTWMOtfo4:fl3js-3eo«[* [$C3 2] 

- (U.S^ 2 A*)(A; l S^ 2 V;).(Jb = 0,l) (33) 

i = ("CS l/ *A)[A" I E^ 2 V T ). (34) 

£(34) fc* (26) <7>»-g5:ifclM-.& i: 

S = CS"' 1 A. (33) 



H = 0C T 

= BA- , f:- , A- T 8 T 

= 9(A T £A)-fi T 

» B(S T 8>- l B T . (M) 



SK, St (24) i X (36) KttA U r 

a 



/'bo(b 0 t b,)- 1 b3- \ (37) 



nets. »<coS:***(D)t«t;flB»3*'-/;«».ffl»4:#a^-4i9iait, *aff^jH«ff*Pi»**i»ffltra 



^ffifT^M^fcgB 3 0 1 TttU *Etf ^J^SB 3 0 0 T? 

5„ -?tj:t>h r = 3mT*fo5„ 
[0 110] tt»JUfcW»^0»«lc*t*4:^trl!l«-C? 

52*, t/i^^S^fe^KlJifcft^oSfcifc&ffl 50 



[0111] «V*T» »g^ffi»bgB3 0 2TU * 

&*<Dmz&-<Wz.tc<Db, mcMPfx-mmnm i © 
[0112] *lt. »e>*vfc«^i»fl[^j©«-*ii*r 

ft < ffi«^i3tl8t-» tSJS-e* 5„ 
[0 113] 9c^reKW«ttU«BJ4 0*»*1ll<i!i«lio 

[0114] g#ffj&m&i4»w&*a>ib&£g#iB& 



(17) 
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i><DVhZ>, c©M:tll0 7(c4&©i$^iJiBft;£ffl^ 
[0115] 1rt£t>*3, lSgroBfjcii^tfiti© 

£>5£>c i &®BisKtzwm<Dm&i i (D 

^©,&>C i ^©SgKtZfc^, Cutlet 10 

±-f 3*7t**5ij(E»nt8B4 ocbv>r, _te r f (i)(j = 1...4) * * t *i ri^j; z) tsai-fc, BfcMifcg 
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i (2) , I i (3) , I i (4) £»JU 

[0116] h&mmz s 1 1 ci^ic^-rs 3 

[0 117] 
[$(33] 



I^{i;Z) = 6 4 (Z)* 



(38) 



- T 



= I i '(ji^)8 T (^ T )- J 



(39) 



iJ(j\Z) = 6^)3 



(40) 



(41) 



nfffistE, (z) tt*js©ji*5a^frn» 

[0 118] Sg«lJ£gB4 2-Ctt, »JcDSg|i§Z££fc 
$*oo±fBI¥«KicE , (Z) OfHISrm\ SfiB 
Nflfcfcft/h (SfflWfcfi*) t1-5Z^t>oT^ro^-C 

[0 119] ^3EH3*J 2 

[0 1 2 0] fclRKlOVvCttS&fc, CC-elffi&LfcS 
[0121] 

[*w©«i*] *»9)£«t*wi. wmmb^m%<Dh 



a s *Ifg->:&!K 3&jgCAD. ifc3^7cCG ( = yf 
[0 12 2] 4fc. #*IHfcJ:*Uf. ftSW-olcRb 

[mil (a) *%w<»m i ©3&iffiB«©*#wfcit 
(b) (a) oifttritist^n^a-efcs. 

[0 3] Hi©3ft3c»stta«B©»»*«***i-y 
[04] m3<D®mm&<5imc>PLwmj8.&7Fi-7 
[05] 0 1 <Dm&mmB&&tt&mv>umti:Mi$ l &7F 

[0 6] Bi©ffi*tt«fcffl«©#»fc«ja&*-*-:/ci 

[0 7] 0 6OE«flJ*8*a(BJC*3V^TfflV^e)*l58MSr 



(18) 
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34 



[0 9] 1 2 ©^ii©Bt)&aif 

[011] fffttTyiJ^Wasw^/iWrftSr^l-^oy^ 
[HI 2] BW(MWWlfBS«)fflift«*«r*i-^By^ 10 
[ft^o&W] 

0 M&fc&U 

1 m»jAttttin 

i o y-mkt&mn 

1 1 2tK7t^m^am.u 

1 2 m&ttft£4i!ittiffi 
i 3 



[02] 



20 

* 

[03] 



1 4 #ft9j£iwifiiftm» 

1 5 m&mu&tomu 

2 o #»j£3ttE;-3tt«B 

2 1 ti-atfr;!iR£ffi 
2 2 mmmmmmm 

2 0 0 ttftj&ftiSftffi 
201 JB0rr**Rjfc* 
2 0 2 tiBMttl-*aS 

2 0 3 

3 1 m&fr&ffijzn 

3 2 ff&fr^MII^S 

3 3 ytm^m^u 

3 0 0 3?ffim«J£$;SB 

301 nmnrnM &<m 

3 0 2 ttftfr^JjEVftA 

40 3&7tmimmft&%i 

4 1 ¥MiM$Cf+3tg|5 
4 2 S»JSgB 

4 3 *fet|-<^ h/Wfl-JMB 
4 4 gfltftjE&S 
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r 



10 



11 
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13 



14 



15 



[B5] 
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21 



22 



20 



31 



33 
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Object 

Motion ^L. Target 
k Object 
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[01] 



rawfftMKttin 



12 



C 



15 



lb) 



20 



£ 



21 



I 



20 



31 



ST 



33 



KMHafftttlill 
35fcjc2£JiEim*tttt:§? 



40 



42 
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43 
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[126] 





, 40 










✓ 4 l 






^—42 








✓ — *3 












, 44 



[08] 



1 o] 




31 



32 



33 



30 



[mil] 



[mi 2] 



BKff?IJE4MMS 



•300 



301 



302 



3^7cXJSH3?tmS? 


^ — 40 










s 41 




r 






s — 42 
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[09] 
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F*-A(##) 2F065 AA04 AA06 AA35 AA37 AA53 
BB05 BB15 CC16 DD06 EE05 
FF04 FF42 JJ03 JJ26 QQOO 
QQ03 QQ13 QQ23 QQ24 QQ25 
QQ27 QQ28 QQ32 QQ33 QQ41 
QQ45 

5B057 AA20 BA02 CA08 CA12 CA16 
CE05 DA20 DC05 DC08 DC36 
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